ON TIGHT GENERALIZED FRAMES 



M. EHLER 

Abstract. Frames can be thought of as collections of rank-one, pos- 
itive semidefinite operators that, if tight, enable signal decompositions 
like orthogonal bases. One refers to generalized frames if the rank-one 
constraint is withdrawn. Given a generalized frame, we construct - in 
a linear fashion - a tight generalized frame whose elements have equal 
norm and are close to the original frame. For integers p, we also intro- 
duce stochastic generalized p-frames and verify that common random 
matrices used in compressed sensing satisfy tightness conditions. We 
then suggest a refinement of the notion of frame redundancy and dis- 
cuss a few supporting examples. 



1. Introduction 

Frames are basis-like systems that span a vector space but allow for linear 
dependency. The inherent redundancy of frames can yield features unavail- 
able with orthonormal bases |18U22| [^5 1 l24|. However, signal reconstruction 
requires the inversion of the frame operator, often a numerically cumber- 
some task. Such drawbacks are void when dealing with tight frames as their 
frame operator is a multiple of the identity. If, in addition, the frame ele- 
ments have unit norm, then frame coefficients measure the signal energy in 
a uniform fashion, often more suitable for signal processing tasks. 

Given a (unit norm) frame, the Paulsen problem asks for the closest tight 
frame whose elements have unit norm and for an algorithm to find it. This 
problem has been addressed and partially solved in [61 [Til 02] • 

Generalized frames were introduced in [Mj as a tool for signal decomposi- 
tion using a set of positive semi-definite (PSD) operators. In [T7], collections 
of orthogonal projectors were considered under the name fusion frames, and 
the concept of tight p- fusion frames was developed in [3]. In the present 
paper, we address the following points: 

(1) We first introduce the Paulsen problem in the context of general- 
ized frames. Given a generalized frame {Tj}™ =1 whose elements have unit 
Hilbert-Schmidt norm, we present an algorithm that yields a unit norm 
tight generalized frame close to {Ij}™ =1 . The latter is the main result of 
this paper. 

(2) We introduce tight stochastic generalized p-frames as subclasses of 
random matrices in W xd , where K is R or C, and the case p = r = 1 
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yields the concept of tight continuous frames as considered in (TJ [25] . We 
verify that a sample from this random matrix forms an almost-tight general- 
ized frame with high probability. Note that the concept of almost-tightness 
was introduced in [p5] and enables signal reconstruction up to any desired 
precision without inverting the frame operator. 

(3) Many types of random matrices are used in compressed sensing |13[ l21j 
to model linear measurements. We shall verify that Gaussian matrices, 
circulant matrices, structured time-frequency measurements, and Fourier 
measurements are stochastic tight generalized p-frames for certain values of 
P- 

(4) The lower and upper redundancy of a frame was introduced in [7J, 
see also [5]. According to the notion in [JJ, the two frames {ei,ei,e2} and 
{ei,e2,ei + e<i\ in M 2 have the same lower and upper redundancy 1 and 
2, respectively. However, the local redundancy, for instance, appears quite 
different in those cases. We shall suggest a refinement of the notion of 
redundancy in Section [JJ and introduce the frame signature as an extension 
of the frame redundancy. 

(5) Switching gears we consider ordinary frames in the space of matrices. 
We verify that weighted orthogonal projectors cannot be tight frames for 
the space of symmetric matrices. 

The outline is as follows: In Section [2j we introduce the concept of (sto- 
chastic) frames and present the Paulsen problem in frame theory. In Section 
[3| we develop the algorithm related to the Paulsen problem. We introduce 
(stochastic) generalized frames in Section [4] and verify our results on the 
random choice of generalized frames. In Section [5j we introduce the Paulsen 
problem in the context of generalized frames and present our algorithm that 
determines a unit norm tight generalized frame. Compressed sensing ran- 
dom matrices are addressed in Section [6] and the notion of frame redundancy 
is refined in Section [JJ In section [8| we verify that a collection of weighted 
orthogonal projectors cannot be a tight frame for the space of symmetric 
matrices. Conclusion are given in Section [9] 

2. Finite frames 

2.1. Definitions and elementary properties. Let K be 1 or C. Follow- 
ing |18| a finite collection of points {xj}" =1 C K. d is called a finite frame for 
K. d if there are two constants < A < B such that 

n 

(1) A\\x\\ 2 <^2\(x, Xj )\ 2 < B\\x\\ 2 , for all x G K d . 

3=1 

The constants A and B are called lower and upper frame bounds, respec- 
tively. We have the following simple characterization of finite frames: 

Lemma 2.1 (|18j). The sequence {xj}™ =1 C K. d is a finite frame for WL d if 
and only if it spans K. d . 
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For any collection {xj}™ =1 C K d , the frame operator 

n 

S : K d -> K d , x^ J2(xj, x) Xj 

3=1 

is self-adjoint and positive semi-definite. If {xj}" =1 is a finite frame, then 
S is positive definite and, in particular, invertible, cf. [18J . In this case, the 
following reconstruction formula holds, 



(2) x = y y (S Xj,x)xj = 2_^(xj,x)S Xj, for all x 6 ~K , 

3=1 3=1 

and {S~ l Xj} 1 j =l is a finite frame too, called the canonical dual frame. 

A collection of points {xj}f =1 C K. d is called a finite tight frame for K. d if 
there is a positive constant A such that 

n 

(3) A\\x\\ 2 = J2\(x, Xj )\ 2 , for all x e K d . 

3=1 

The constant A is called the tight frame bound. If, in addition, A = 1 holds, 
then we call {xj}f =1 a Parseval frame. Tight frames and Parseval frames 
directly lead to the reconstruction formula 

1 - 

(4) x = — Xj)xj, for all x £ K d , 

3=1 

since their frame operator is A times the identity, cf. [18J. 

2.2. The Paulsen problem. Here, we shall find Parseval frames that are 
close to a given frame. If we do not require any further features, then the 
following Theorem yields the closest Parseval frame together with its explicit 
construction: 

Theorem 2.2 (|16]). If {xj}^ =1 C K. d is a finite frame with frame operator 
S, then {S-V 2 Xj}] = 1 is a Parseval frame and, for any other Parseval frame 
{yj}]=i, we have 

n n 

\\xj - s-^xjW 2 < ^2 \\ Xj - yj f. 

3=1 3=1 

Equality holds if and only if {yj}" =1 = {S^^^^Xj}™^. 

The Parseval frame {5 _1 / 2 Xj}™ =1 is also called the canonical tight frame 
associated to {xj}™ =1 . It becomes a much harder problem if the elements 
of the Parseval frame are requested to have equal norm. In this case, a 
characterization as in Theorem 2.2 has not yet been found and has become 
known as the Paulsen problem, cf. [61 [TT| [15] . 

Normalization of a Parseval frame yields a finite tight frame whose ele- 
ments lie on the sphere S^ -1 but, in general, it may not be tight anymore. 
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An algorithm to compute a finite tight frame {yi}f =1 C S^ -1 that is close to 
a given collection {xj}™ =1 has been developed in [15] and led to the following 
result. Here, ||M||^ S denotes the Hilbert-Schmidt norm of a matrix M E 
K rxd , and the inner product of M X ,M 2 G K rxd is (M 1 ,M 2 ) := trace(M*M 2 ), 
so that ||M|||- 5 = (M, M) . 

Theorem 2.3 (|15j). Suppose that n and d are relatively prime and n > d. 
If the frame operator S of {xi}f =1 C S^ 1 satisfies \\S — ^Id\\%s — W' ^hen 
there is a tight frame {yi}" =1 C S^ -1 such that 



(5) ^Wxi-yifKMdVWS-^W 



\HS- 



A lower bound on the distance between {xj}™ =1 C S and the closest 
tight frame on the sphere is given in the following proposition, in which 
the first estimate is already contained in [15], and the second estimate is a 
consequence of the first one: 

Proposition 2.4. Suppose that {xi}f =1 C S d ~ 1 with frame operator S. If 
{y«lr=i ^ S d ~ l is a tight frame, then both of the following estimates hold, 



(6) Ei^-^ii 2 ^i^ 1/2 -\/>ii 



n 



2 



(7) ElN- y*W 2 * n( ,i/2 + ^ W S ~ l^Wns- 



(dV2 + l)2» d' 



Note that Q is weaker than ^ but incorporates the frame operator 
directly instead of its square root. 



3. An algorithm related to the Paulsen problem 



Theorem 2.2 says that the Parseval frame closest to a given frame can 
simply be obtained by applying a linear map. In general, we cannot find a 
linear map if we additionally require the elements of the Parseval frame to 
have equal norm. Here, we shall linearly map the frame to another frame 
whose elements only require normalization in order to form a Parseval frame. 

Given samples {xj}'j =1 C S^ 1 , the closest equal norm frame is simply 
derived by rescaling. We shall construct a unit norm tight frame that is 
close to {xj}™ =1 , and rescaling by the factor y 1 djn yields an equal norm 
Parseval frame. 

Let V be the collection of hermitian positive definite matrices in K. dxd 
with trace 1. For T = \h G V, we define the iterative scheme 

1/2 11/2 
/o\ -n 1 k lvI k 1 k 

trace(r fc M fe ) 
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Figure 1. original frame {xj}| =1 in blue, optimal frame 
{zj}^ =1 = {RgZj}j =1 in green, and our proposed algorithm 
finds {yj}^ = i in red. (Green and red lines are sometimes 
right on top of each other). 



where 

(9) M(T) = ~£ ^— and M k = M(T k ). 

j=i j j 

If {xj}™ =1 spans K d , then the scheme is well-defined and r k G V . 

To ensure convergence, we assume that n > d(d — 1) and that each subset 
of d vectors spans If the latter condition does not hold originally, then 
we may "wiggle" a bit, so that the new set of vectors satisfies the condition. 
Then Theorems 1 and 2 in [28] imply that the iterative scheme Q converges 
towards T £ V. A direct computation yields that M(T) = Id must hold. We 
now linearly map Xj into jjj by applying T 1//2 , i.e., {yj}™ =1 = {T l ^ 2 Xj}^ =l . 

Since Af(T) = I d , we obtain that {yj}] =1 = {^}j=i c ^ is a fimte 
tight frame. 

There are some heuristics suggesting that the above scheme finds a tight 
frame on the sphere that is close to the original frame: The iterative scheme 
([8]) is applied as an M-estimator in [281 EZ] related to the population co- 
variance of the samples {xj}™ =1 . Thus, we can expect that if the sample 
covariance (assuming zero mean, this is - Y^j=i x j x *j) is close to a multiple 
of the identity, then T is close to the identity, which would then imply that 
Uj is close to Xj. 
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We illustrate the performance of our algorithm in the following example: 

Example 3.1. Let d = 2, n = 3, and, for simplification, we only consider the 
situation when the given frame and the tight frame have real entries. We pick 
a±,a2,Oi3 from a uniform distribution on [0, 2ir] and define Xj = (^(a^j)' 
j = 1, 2, 3. By multiplication with —1 and rotation of all 3 vectors, we can 
restrict the angles to lie between and §7r. For each random choice {xj}j =l , 
we compute a tight frame {yj}j =1 C S 1 using our proposed algorithm. Up to 

rotations Re = (^^j^ cos(#) J an< ^ mur kip nca ti° n by —1, there is only 
one single tight frame having real unit norm vectors. We choose {2j}^ =1 , 
where Zj = (g^^j) and (3i = 0, 02 = 1/3-7T, and (3% = 2/3it. Therefore, to 
find the tight frame with unit norm that is closest to {xj}j =1 , we minimize 
the distance to {xj}j =1 over all rotations, i.e, 

3 

9 := arg min \\RgZj — Xj\\ 2 , 

0e[-2/37r,2/37r]^ J J 

and define the closest tight frame by {zj}j =1 := {R e Zj}j =1 . Note that we 
can suppress the multiplication by —1 because the angles of {xj}| =1 only 
run m [0, §tt]. The average error of \\ z j ~ UjW^ over 1000 realizations 

is ~ .0016 = 1/625, see also Fig. [I] for a visualization of few examples. In 
our numerical experiments, we observed that our proposed algorithm finds 
a tight frame that is almost identical to the optimal tight frame if all pairs 
Xi and Xj, for i ^ j, are far enough from each other. 

4. Generalized frames 

Here, we introduce a more general concept of frames than in the previous 
sections and discuss their properties. 

4.1. Definitions and characterizations. Let fi be a locally compact Haus- 
dorff space and B(£l) be the Borel-sigma algebra on endowed with a prob- 
ability measure //. We first fuse the concepts of generalized frames and 
probabilistic frames as developed in [M] and [24] , respectively: 

Definition 4.1. Let p > 1 an integer. We say that a random matrix 
T : Q — > K rxrf , r < d, is a stochastic generalized p-frame if there are positive 
constants A p ,B p > such that 

(10) A p \\x\\ 2p < [ \\T(uj)x\\ 2p dfi(uj) < B\\x\\ 2p , for all x € K d . 
Jn 

A stochastic generalized p-frame is called tight if we can choose A p = B p . 
If, in addition, /i is a counting measure whose support is {ojj}™ =1 and 
T{ujj) = Tj, for j = 1, . . . ,n, then we call {Tj}™ =1 a generalized p-frame 
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or a generalized tight p-frame, respectively. In case p = 1, we call {Tj}" =1 
Parseval if A\ = B\ = 1. 



We obtain the analogous result of Lemma 2.1 for (stochastic) generalized 
frames: 

Proposition 4.2. Let {Tj}" =1 be an arbitrary finite collection of matrices 

in W xd , r < d, and let T : $7 — >■ W xd be a random matrix with respect to a 
Borel probability measure uonVt. 

1) Then {7}}™ =1 is a generalized p-frame if and only i/IJj=i range(T^) 
spans K d . 

2) If T satisfies the upper bound in (10), then T is a stochastic gener- 
alized p-frame if and only if LLesupp(^) range(T*(w)) spans K d . 



Note that Proposition 4.2 says that {Tj}™ =1 is a generalized p-frame for 
some p if and only if it is a generalized p-frame for the entire range p > 1. 



Proof. For the finite collection, the upper frame bound in ( 10 ) can be defined 
as B : = ]Cj=i ll^jl| 2p - Therefore, 1) follows from 2), and we only consider 
T. If 

U range(T*(u;)) = ( f| nuU^cd))) 1 

<^>Gsupp(/i) u;£supp(/t) 

does not span ]K , then there exists a nonzero element x G fl^gsupp^) null(T(w)). 
Therefore, (10) cannot hold. 

For the reverse implication, let us define 

a ■.= mf ( Un^fM^h = / r mu)xrMu 

where S"^ 1 = {z G K d : ||z|| = 1}. The mapping \\T(uj)x\\ 2p dii(uj) is 

continuous and the infimum is in fact a minimum since S^ 1 is compact. Let 
x G S^ -1 such that A = J fi ||r(a;)x|| 2 (ip(cj). According to the assumption, 

x p| null(r(w)). 

wSsupp(^i) 

Thus, there is wo £ supp(p) such that ||T(wo)x|| 2p > 0. Therefore, there is 
e > and an open subset C f2 such that loq G J7 Wo and ||r(w)x|| 2p > e, 
for all u) G ?7 Wo . Since fj,(U Uo ) > 0, we obtain A > e[i(U Uo ) > 0, which 
concludes the proof. □ 

Following the lines of the proof for rank one projectors considered in 
yields that any stochastic generalized 1-frame T w.r.t. (jl satisfies 

(11) A! <± JjT^fHsdfiiu) < Bl 
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Similar to finite frames, if T is a stochastic generalized p-frame, then the 
stochastic generalized frame operator 

(12) S:K d ->K d , I T*(u)T(u)xdfi(u) 

Jn 

is positive, self-adjoint, and invertible, cf. [M] for counting measures \x. 
Thus, we obtain the reconstruction formula 

(13) x = [ S~ l T*(uj)T(uj)xdii(uj). 



Jn 

Moreover, fj, is a tight stochastic generalized 1-frame if and only if S = eld, 
where c = \ f n \\T(oj)Wjj S dfj,(oj). Next, we define and discuss a stochastic 
generalized frame potential whose minimizers characterize tight stochastic 
generalized 1-frames. 

Definition 4.3. Given a Borel probability measure \i on £1 and an associated 
random matrix T : f2 — > W xd with stochastic generalized frame operator S, 
we call 

(14) *(T, M ):= / /(r*( w )rH,T*(^)T( w ')>^M^(^) 

Jn Jn 

its stochastic generalized frame potential. 

Tight stochastic generalized frames can be characterized as minimizers of 
the above potential among all Borel probability measures on and random 
matrices T with fixed mean Hilbert Schmidt norm m = Jq \\T(u))\\jj S d[i(u)): 

Proposition 4.4. If T is a random matrix with Borel probability measure 
[i on Q, then 

HT^)>- d {JjT{u)f HS d^Lo))\ 
and equality holds if and only if T is a tight stochastic generalized 1-frame. 
We observe that <&(T, fi) = trace(5 2 ) so that considering the eigenvalues 



of S as in [TH [22] implies Proposition 4.4 



Tight stochastic generalized frames are closely related to the concept of 
positive operator valued measures (POVM) as widely used for quantum mea- 
surements: 

Definition 4.5 Q20J). We call F : B(fi) -> K dxd a POVM on n if the 
following points hold: 

(i) F(A) is positive semi-definite, for all A £ B(Q), 

(ii) F(fl) is the identity matrix, 

(iii) If {Ai}i£j is a countable family of pairwise disjoint Borel sets in 
B(Q), then 
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If, in addition, supp(F) = {ujj}^ =1 is finite, then we identify F with a 
finite collection of positive semi-definite matrices {Fj}™ =1 that we also call 
aPOVM. 

Any stochastic tight generalized 1-frame induces a POVM by 

Jn WT^WhsM^) J a 

This means in the finite setting that any tight generalized 1-frame {Tj}™ =1 
gives rise to a POVM by normalizing {T*Tj} r j =1 . Conversely, any POVM 

1 /2 1 /2 

{Fj}"j =1 induces a tight generalized 1-frame {F- }™ = i- Moreover, each F- 
can be replaced with weighted projectors, see [12] . 



4.2. Approximate dual generalized frames. The inversion of the frame 
operator can be numerically cumbersome. To avoid it altogether, the con- 
cept of approximate dual frames was introduced in [19]. We shall extend 
this concept to generalized frames and use it with random samplings from 
a stochastic generalized 1-frame. 

If {Tj}" =1 is a generalized p- frame with generalized frame operator S, 
then {TjS'~ 1 }?? x is called the canonical dual generalized p-frame. Indeed, 



{TjS 1 }™ = i forms a generalized p-frame, and ( 13 ) implies the reconstruction 
formula 

n 

x = Y^{T j S- 1 )*T j {x), forallxGlC d . 
3=1 

Since {Tj}™ =1 may inherit some redundancy, there can also exist alternative 
choices, and we call {Rj}™ =l a dual generalized p-frame if 

n 

(15) x = R*jTj(x), for all x G K d . 

i=i 

The analysis operator of a generalized frame {Tj}™ =1 is 

n 

T : K d -> Yl K r , x ^ (Tj(x))] =1 . 
3=1 

Its adjoint is the synthesis operator 

n n 
3=1 3=1 

such that the generalized frame operator is S = J 7 * J 7 , which is consistent 



with (12). The identity (15) means Id = J-^J-t, where Tt and J-r are the 
analysis operators of {Tj}™ =1 and {Rj}™ =l , respectively. 

When it is sufficient to approximate x up to some precision, then we may 
not need an exact dual frame. We say that a generalized p-frame {i?j}" =1 
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is an approximate dual to {Tj}™ =1 if 

(16) \\I d - TrTtWoo < 1. 

Any approximate dual gives rise to a sequence of approximate duals that 
allow reconstruction of x as precise as needed: 

Proposition 4.6. Let {i?-,}™ =1 be an approximate dual generalized frame to 
the generalized frame {7}}™ =1 and let e := [[1^ — J-rJ-t\\oo < 1- Then the 
analysis operator Fq(n) associated to the collection {Q^ }™ =1 defined by 



N 



i=l 

satisfies \\Id — ^(jvj^rlloo < e N+1 — > as N — > oo. 

The statement can be derived by minor modifications of the lines in 
the proof of Proposition 4.1 in [19], where standard frames are considered. 
Therefore, we omit it here. 

If a generalized frame operator S satisfies \\L<i — <S||oo < 1> then the un- 
derlying generalized frame is approximately dual to itself. In the following 
theorem, we shall verify that random samplings yield generalized frame op- 
erators that are sufficiently close to the identity. For results on random 
vectors, we refer to [39]. 



Theorem 4.7. Let {Tj}™ =1 be independent copies of a stochastic tight gen- 
eralized 1- frame T : f2 — > W xd , where ||T||^ 5 = R with probability 1 for 
some positive constant R. For fixed e £ (0,1], there are positive constants 
7e,c £ > such that, for all n > c e dln(d), the frame operator S n of the 

scaled collection {\J~-^pTj}^ =l satisfies ||/^ — Snlloo < e with probability at 

n 

least 1 — e lE <i . 

Proof. Let A m j n (5 n ) and A max (5' n ) denote the smallest and largest eigenvalue 
of S n , respectively. The matrix Chernoff bounds as stated in [36] yield, for 
all < e < 1, 

P(A min (5 n ) < 1 - e) < d( n e " ) n/d 



P(A min (5 n ) > 1 + e) < d( n * 1+£ ) n/d . 



(1-ey 
. e^_ 



Some calculus yields 

(l + e^il-ey- 1 <e 2e , Ve € [0, 1] 

so that we derive 

d 
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We can further compute 

. 

'(1+1 



2d( „ e ^ l+£ ) n/d = 2de-^ l+£ ^ l+e ^ 



e -5((l+ £ )ln(l+ £ )- £ -^ln(2)ln(d))_ 



Since (1 + e) ln(l + e) — e > 0, for all e £ (0, 1], we can find a suitable 
constant 7 £ > if n is sufficiently large. □ 



Remark 4.8. The constants 7 £ and c £ in Theorem (4.7) can be explicitly 
computed. By using a e := (1 + e) m(l + e) — e > 0, we can choose c e > 
and 7 e = a e - ^^M. 

5. PARSEVAL GENERALIZED FRAMES CLOSE TO A GIVEN GENERALIZED 

FRAME 

As with finite frames, it is natural to ask for the closest stochastic Parseval 
generalized frame to a given stochastic generalized frame. The following 



result generalizes Theorem 2.2 



Theorem 5.1. IfT is a stochastic generalized frame with generalized frame 
operator S, then TS~ l l 2 is a stochastic Parseval generalized frame and, for 
any other stochastic Parseval generalized frame R, we have 



(17) / \\T{u) - T(u})S^ 2 \\ 2 hsM") < / \\T{u) - R( U )f HS d^u). 
Jo, Jn 

Equality holds if and only if R = TS 1-1 / 2 almost everywhere. 



Most parts of the proof of Theorem 5.1 follow the lines in |16j . where 



Theorem 2.2 is verified. Deviations due to the more general situation are 
quite straight-forward, so we omit the proof. 

For r = 1, we recover the finite frame {xj}™ =1 C K. d as the rank one 
operators {x^}" =1 , and the corresponding generalized frame operator is 



3=1 3=1 

The canonical tight frame {iS - 1 ' 2 ajj}" =1 C K rf is associated to the general- 
ized frame {x*5~ 1//2 }™ =1 , so that Theorem 



5.1 



matches Theorems 



the generalized frame is induced by a finite frame. 



2.2 



when 



Remark 5.2. Similar to the standard Paulsen problem, cf. [61 1111 US] , the 
situation becomes more complicated if, given a stochastic generalized frame 
T, we look for the closest stochastic Parseval generalized frame that inherits 
further structure, such as being formed by orthogonal projectors or similar 
conditions. Some structures are preserved from T itself, and, for instance, if 
T is self-adjoint a.e., then TS 1-1 / 2 is so too. Similarly, if T is positive (semi- 
definite a.e., then so is TS" -1 / 2 . However, if T is an orthogonal projector 
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(or has unit Hilbert Schmidt norm) a.e., then TS~ l l 2 may often not be 
an orthogonal projector (or does not have equal norm), and one needs an 
alternative construction. To our knowledge, these are still open problems. 

Given a generalized frame, we shall adopt the algorithm proposed in Sec- 
tion [3] to construct a tight generalized 1-frame {Rj}™ =1 with unit norm 

H-Rjll-ffS = 1; for j = l,...n. Rescaling by the factor \J~djn yields the 
desired equal norm Parseval generalized 1-frame. 

By following the ideas in ^ and Q, we define Tq := ^Id an d, recursively, 



(18) 
where 



k+1 trace(r fc M fc - 1 ) 



, n -pl^j^ji.pl^ 

M(T) = -V- y— and M k = M(T k ) 

n trace! Tj FT*) 



Next, we use the scheme (18) to compute a unit norm tight generalized 1- 
frame. This generalizes results in I37j for frames in ~S, d . Our results here 
cover the more general setting of generalized frames in K. d : 

Theorem 5.3. Let {Tj}™ =1 be a generalized frame satisfying \\Tj\\Hs = lj 
for j = 1, . . . n. Moreover, let n > d(d — 1) and suppose that, for any subcol- 
lection of q distinct operators {Ti j }j =1 , 1 < q < d, the set U|=i ran g e (^i* ) 
spans a subspace of K. d whose dimension is at least q. Then the recursive 
scheme (18) with Tq = \ld converges towards a positive definite V and 



TjT l/2 



{Rj}™ 1 ^ defined by 

IMji 1 Whs 

is a tight generalized 1-frame with \\Rj\\gs = 1» f or j = 1> • • • ? n - 

Proof. Since {Tj}™ =1 is a generalized frame, the sequence {r/ c }^ =1 is well- 
defined. It is also clear that T k is hermitian positive definite and trace(rfc) = 
1, for all k = 0, 1, 2, . . .. If we suppose that {Tk}% x L 1 converges towards T, 
then M(T) = Id must hold, and a direct computation yields that {i?j}" =1 
is a tight generalized 1-frame with ||.Rj||hs = 1, for j = 1, . . . , n. 

To verify convergence, we shall follow the ideas of the technical 3-step 
procedure used in |28} 137] for frames in M. d . 

Step 1) (refers to Theorem 2.1 in [37J) We shall verify that, M(T a ) = 
M(Tb) if and only if T a = cTb for some positive factor c. Without loss of 
generality, we can assume that Tf, = la- Otherwise, replace {Tj}™ =1 with 

— 1/2 

{TjF b }j=i- Let 71 be the largest eigenvalue of T a and Pi be the associated 
eigenprojector. Moreover, let {Pi} r i=2 be one-dimensional eigenprojectors of 
T a associated to eigenvalues {7i}[ =2 such that 71 > 7^, for i = 2, . . . , r, and 
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Yli=i lrP% = r o - Note that 72, . . . ,j r do not need to be pairwise distinct. 
We obtain 



< 



^ trace^TiT/) n ^ ELi 7i trace (Tj Pi TJ") 



71" E / ( '^ =PiM{I d ) 

n ^ — ' <vt trappl / / . 



" 71 trace(T J T J 



Now, M(T a ) = M(I d ) implies that either trace(T,,PT,*) = 0, for all j = 
1, . . . , n and i = 2, . . . ,r or Pi = Id and, hence, T a = 71/rf. Since {Tj}" =1 
is a generalized frame, trace (T^PjT^*) cannot vanish simultaneously for all 
j = 1, ... ,n, so that, indeed, T a is a nonzero multiple of the identity. 
Step 2) (refers to Lemma 2.1 in |37j ) Let Ai^ and X^k be the largest and 
smallest eigenvalue of Mfe, respectively. Following the lines of the proof 
of Lemma 2.1 in 3?) yields that {Xi^^Li ^ s a decreasing sequence that 
converges towards Ai > 1. On the other hand, {\d,k}kLi is an increasing 
sequence that converges towards A^ < 1. 

Step 3) (refers to Theorem 2.2 and Corollary 2.2 in [37|) Here, we need 
n > d(d — 1) and the additional assumptions in the theorem. Then we can 
follow the lines of the proofs of Theorem 2.2 in |37| and Corollary 2.2 in [37] . 
so that Steps 1 and 2 yield the convergence of Tk towards a positive definite 

r. 

□ 

Let us have a look at few pathological examples first: 

Example 5.4. 1) If {Tj}™ =1 is already a unit norm tight generalized 
1-frame, then r x = F = \l d and {Rj}] =1 = {Tj}] =v 
2) If the generalized frame consist of a single matrix T 6 W xd , then 
Ti = T = T*T and @ yields R = ^T(T*T)- 1 / 2 , which is a unit 



norm tight generalized 1-frame. 



Next, we illustrate Theorem 5.3 with two numerical examples: 



Example 5.5. For < t < 1/2, define 

^)-(^ £)■ *«'>-(? r ^ 

and let denote the associated generalized fr ame operator. Note that 




{Tj(t)}| =1 satisfies the assumptions of Theorem 5.3, for all < t < 1/2. 
If t = 0, then we have a tight generalized 1-frame with unit HS-norms. 
Our algorithm provides a Parseval generalized 1-frame {^2/3Rj(t)}^ =1 with 



equal HS-norm, see Fig. [ijfor the errors X^|=i ll^i(^) 
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Figure 2. t versus the distance (blue) Y%=i II^K*) 



y/2/3Rj(t)\\HS and ( red ) E 
in Example 



5.5 



Note 



3 

J'=l 

that 



{Tj(0)}j =1 is tight but 
needs rescaling to become the Parseval generalized frame 
{^/2/STj(0)}^ =1 . It is clear that Rj(0) = Tj(0) 

and y/5/3Tj(0) = T i (0)S'(0)- 1 / 2 holds, and we have 
Y%=i ll T i(0) - Vy3Tj(0)\\ 2 HS = 0.1010. The latter explains 
why the distance plots do not start at 0. 



Example 5.6. We choose each entry of each element in {Tj}| =1 C K 2x2 
independently according to a uniform distribution on [0, 1] and normalize 
so that ||Tj||#s = 1. All numbers in the following are averaged over 10, 000 
realizations, and let S denote the generalized frame operator of {Tj}^ =1 . 

5ll {TjS' 



According to Theorem 



-l/2}3 



j'=i 



is the Parseval generalized 1- 



■TjS- 



frame that is closest to {Tj}j =1 , and we compute Y^j=i II- 
0.61. However, the elements of {TjS'~ 1 / 2 }'- =1 may not have equal HS-norm. 



-1/21 



2 

HS 



Based on Theorem 



5.3 



the collection {Rj} 3 j=1 = {y/2/3Rj}? =1 is a Parse- 
val generalized 1-frame, its elements have equal HS-norm, and we compute 
E|=i — RjWns ~ 0-71. Thus, the additional property of having equal 
HS-norm costs ~ 0.10 = 0.71 — 0.61. It remains open though if there are 
other Parseval generalized 1-frames whose elements have equal HS-norm and 

• )lj=V 



that are closer to {Tj}, 



Let us also illustrate when the algorithm fails to converge: 
Example 5.7. For t = 0, the collection {Tj(t)}j =l , where 



Ti(t) 



1 




r 2 (t) 



1 t 




and T$(t) 




1 



violates the conditions in Theorem 5.3 and indeed, the iterative scheme 



does not converge towards a positive definite matrix T. For t > 0, on the 
other hand, we observe convergence numerically, consistent with Theorem 

nag 
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Remark 5.8. To the best of our knowledge, our proposed algorithm is the 
first attempt in the literature to compute a unit norm tight generalized 1- 
frame that is close to a given unit norm generalized 1-frame. Estimates on 
the distance to nearby unit norm tight generalized 1-frames do not seem to 
exist either. 

6. Compressed sensing matrices 

In this section we shall verify that the random matrices used in compressed 
sensing [13\ [21] form tight stochastic generalized p- frames. 

6.1. Gaussian matrices. Let 1 < k < d and consider the k x d random 
matrix G whose entries are i.i.d Gaussian. Its joint element density is 

(20) M ^J 27 ^ e M-l\\Mf HS ), 

and the resulting self-adjoint matrix G*G G M. dxd is a Wishart-matrix, whose 



distribution is singular since its rank is k < d, cf. [38]. According to (20) 
the distribution of G is unitarily invariant, so that G is a tight stochastic 
generalized p-frame for all integers p. By using the moments of the chi- 
squared distribution, we see that the bounds satisfy A v = B p = k{k + 
2)---(fc + 2p-2). 

6.2. Circulant matrices. Given a vector x = (x\, . . . , x d ) T £ the 

corresponding circulant matrix is 

f xi x d ... x 2 \ 

X 2 Xl ... x 3 

C = 

\X d X d _i ... XlJ 

Each column of C is a cyclic shift of the previous one, which can be per- 
formed by applying the matrix T, having ones in the lower secondary diag- 
onal, another one in the upper right corner, and zeros anywhere else. The 
upper k x d block D of the matrix C was used as a compressed sensing 
measurement matrix in [31] . If the entries of x are i.i.d. with zero mean 
and non-vanishing second moments, then D is a stochastic tight generalized 
1-frame with A\ = fcE(x?). For instance, if x is the Rademacher sequence, 
i.e., entries are independent and equal to ±1 with probability 1/2, then D 
is 1-tight but not 2-tight. 

6.3. Fusion frames. Let us consider generalized frames that have addi- 
tional structure. If the elements of a generalized frame {Tj}™ =1 C K. dxd are 
all multiples of orthogonal projectors of rank k, then we can identify them 
with subspaces {Vj}" =1 C £/fc,<f(K) and positive weights {wj}™ =1 and call 
{(Vji v j)} 1 j=i a fusion frame, cf. pT]. Hence, we have Tj = ^VjPy., where 
Py. denotes the orthogonal projector onto Vj. From a different perspective, 
a fusion frame can be identified with a weighted collection {(Mj, Vj)}^ =1 in 
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the Stiefel manifold V M = {M G K k ' d : MM* = I k }, so that the rows of 
Mj are an orthonormal basis of Vj implying that TjTj = VjMjMj = VjPy^ 
Thus, both {y/VjMj}* =1 C K kxd and {y/VjPv^i C K dxd "describe" the 
fusion frame {(Vj, fj)}™ = i- Fusion frames were used for compressed sensing 
approaches in |10j . 

6.4. Gabor. Time-frequency structured measurement matrices were con- 
sidered in |30j in relation to compressed sensing. The translation T is per- 



formed by the cyclic shift as in Section 6.2 and the modulation operator on 
C d is given by 

M = diag(l, e 2ni/d , e 2 «(d-i)/d). 

For any nonzero g £ C d , the full Gabor system {M e T k g : I, k = 0, . . . , d— 1} 
has cardinality <i 2 and forms a tight frame for C d , cf. [29j. We shall use the 
d x d 2 matrix G, whose columns are formed by the tight frame vectors. A 
short computation yields that, if g is chosen at random as the Rademacher 
sequence, then G is a stochastic tight generalized 1-frame. Moreover, each 
G*G is an orthogonal projector, so that G*G corresponds to a stochastic 
tight fusion frame. The same holds when g is the Steinhaus sequence, i.e., 
each entry is uniformly distributed on the complex unit circle. 



7. Frame signature 

Given a generalized frame {Tj}™ =1 , we call the sequence of lower and 
upper optimal generalized frame bounds (A p ) p % 1 and (B p ) p *L 1 of the nor- 
malized system {3j/||?j||/rs}" = i ^ ne l° wer an d upper generalized frame sig- 
nature, respectively. We call B p — A p the p-th gap of the generalized frame. 
For a stochastic generalized frame T, we define the signature consistently as 
the optimal lower and upper frame bounds of the random variable T{uS) := 
T(w)/||T(a;)[|, for T(u) / and f (w) := otherwise. 

For a frame {xj}™ =1 C M d , the first entry of the lower and upper frame 
signature coincides with the lower and upper frame redundancy as proposed 
in [7|. Note that the signature is invariant under the action of unitary 
operators, reweighting, and permutations, so that we are consistent with 
[7j. Moreover, the lower frame redundancy was aimed to yield the number 
of vectors that can be removed yet still leave a frame. The authors in [7] 
claim that [^lj — 1 many vectors can be deleted yet leave a frame. In 
fact, the number can be replaced with \A{] — 1, but, still, this is only a 
lower bound on this quantity. We claim that the frame signature allows a 
refinement and support our ideas with a collection of examples. 

7.1. Examples of the frame signature. The first entry of the lower and 
upper frame signature for both collections {e\, e\, e{\ and {e\, e<i, e\ +e2} is 
(Ai,B\) = (1, 1). However, the type of redundancy appears to be different in 
both sets. From the first set, we can remove one element and the remaining 
set has lower frame redundancy zero. Removal of an arbitrary element of 
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the second collection leaves us with a lower frame redundancy bigger than 
0.29. It may be possible to "see" such differences in the frame signature. 
By using results in [3J, we observe that the signature of a frame {xj}" =1 

for M. d satisfies A p < U rMy < B p , and in the complex case we have A p < 



H£j2^ — -^pi OUU.U. Ill L11C UUlll^lCA I^OjOC WC 11CXVC -Tip 



n T£T — Bp, where (a) p = a(a + 1) • • • (o + p — 1). 



Example 7.1. 1) The frame {ei, . . . , ei, e2, e3 . . . , e^} for M. d , where ei 
occurs k times, satisfies B p = k, for all p > 1, and vli = 1. Some 
calculus yields ^4 p = (d — 1 + fe -1 /^ -1 )) p for p > 2. Thus, the gap 
Bp — A p converges towards k. 
2) The frame signature of {ei,e2,ei + e2} C M 2 satisfies A\ = 1 and 
B\ = 2, and ^2 = 1/2 and -B2 = 3/2. We can compute using calculus 
that A p = 2 1 ~p and B p = 1 + 2 1 " p . Thus, the gap is B p - A p = 1 
for all p > 1 . 



For d = k = 2, the lower bound in Example 7.1 1) is bigger than in 
2), but the gap is smaller in 2). 

Example 7.2. 1) The frame signature of k copies of an orthonormal 
basis for ~K d is A p = kd x ~ v and B p = k, for all p > 1. The gap is then 
Bp — A p = k(l — ;s=t) an d, therefore, increases in p and converges 
towards k. 

2) The frame {ei, e 2 , ^(ei + ^2), ^§( e i ~ e 2)} C K 2 is p-tight for p = 
1, 2, 3, so that At=Bx = 2 and 4 2 = B 2 = 3/2, and A 3 = B 3 = 5/4. 
It is not 4-tight since A4 = 34/32 and B4 = 36/32 while the tight 
4- frame bound would be 35/32. 



By some calculus and using the points (1, 0) and (y § + y | 5 \/§ 
(cos(7r/8), sin(7r/8)), we can derive 

^ = 2 1 - p ((l + y / |) p + (l-y / |) p ) and B p = l + 2 1 ~i>. 

For instance, we see that Bio — A\o < 0.6, and the gap converges 
from below towards 1. 



For d = k = 2, the Examples 7.2 1) and 2) are both the union of two 



orthonormal bases, but 2) appears more uniformly distributed than 1). The 
following example is a modification of [7J Example 2.8]: 

Example 7.3. Let e 2 < The frame 

{ei, \A - e 2 ei ± ee 2 , £ 2 e\ ± ee d } 

has 2d — 1 elements and satisfies 
2f 2 p 

A p= (d-i)P-i and ^ = l + 2(d-l)(l-e 2 ) p . 
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Note that B p — A p > 1 for all p and if p tends to infinity, then the gap 
converges towards 1. If p is fixed and e tends to zero, then the gap converges 
towards 1 + 2{d — 1). 

For a fusion frame {(Vj, Vj)}™ =l with {Vj}™ =1 C Qk,d, the fusion frame 
signature is consistently defined as the lower and upper generalized frame 
bounds of the system {A; _1 ' 2 Pv J }5 =1 . By using results in [3], we see that the 

fusion frame signature satisfies A p < nk^ 1 ^ 2 ^J^ p < B p in the real case and 

A p < nk^ 1 / 2 ^^- < Bp in the complex setting. 

7.2. Theoretical result for d = 2. Let us formulate a result showing that 
the higher orders of frame gaps carry useful information: 

Proposition 7.4. If the first p gaps of the frame signature of {xj}™ =1 C C d 
vanish, then any removal of p elements leaves us with a frame. 

To prove the above proposition, we need the following lemma: 

Lemma 7.5. // the first p gaps of the frame signature of {xj}™ =1 C C d 
vanish and Z = ( ©™ =p+1 XjC)" 1 , then, for all x G S^ 1 \ Z, 

#{y G S^ 1 : (P Xp+1 c(v), Px n dv)) = (P Xp+1 c(x), . . . , P Xn c(x))} < oo. 

Proof of Lemma \ 7. 5\ If p < ^, then {xj}™ =p+1 is a frame and, therefore, 
spans C d , so that the statement holds. To address p > ^, let x G 5' d ~ 1 \Z and 
denote Vj := XjC with aj = 1/n. Since the tight p-fusion frame {(Vj, aj)}^ =1 
is also a tight fusion frame for 1 < i < p, the vector ( 1 1 Py 1 (x) \ \ 2 , . . . , 1 1 Py p (x) 1 1 2 ) 
is among the solutions of the system of algebraic equation 
P /, s n 

(21) zZ a ^ = w~ ^ a iW p vMW n > i<*<p- 
j=i { n j= P +i 

According to [3, Proposition 7.1], the cardinality of the set of solutions S is 
finite (in fact, at most p\). Moreover, Proposition 7.2 in [3j not only holds 
in the real case but also for complex tight 2-frames, so that 

1 n 

(22) P zC = - aj\\P Vj [z)\\ 2 P V] - I d , for all z G S d ~\ 



where a = d ( d+1 ^ , see also [3]. We apply (22) by choosing z = x and 
replacing {Pvj ( z )}^=\ with {tj}^ =1 , where (t\, . . . ,t p ) G S. If the right-hand 
side indeed defines a one-dimensional projector, we choose a vector in its 
range with norm one. Let {£i}f =1 C S^ 1 denote this set of vectors. Since 
x Z, the vector (Py p+1 (x), . . . ,Py n (x)) must have at least one nonzero 
entry Pv p+jQ (x). We define 

L := {A£ : £ G fe}? =1 , 3A G C, |A| = 1, Pv v+0Q (A£) = Pv p+jo (x)} 
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that is apparently a finite set. Finally, any £ G S d 1 satisfying -Py p+1 (£) = 
fVp+iO*;), • • ■> ^V„(£) = Pv„( x ) must lie in L, which concludes the proof. □ 

Proof of Proposition \1.J\ Without loss of generality, we shall verify that the 
last n—p subspaces span C d . Aiming at a contradiction, we assume that they 
span a subspace of dimension le ss th an d (it is impossible that the dimension 

and let x = x a + Xb G S^ 1 \ Z such that 



7.5 



is zero). Let Z be as in Lemma 

x a G Z and x;, G Z 1 - so that < 1. Since x G" Z, we see that x a / / x^. 
However, any element in «Sf n where 

.if := {Xx a + x fe : A G C}, 

would lead to the same set {-fV i (a ; )}f=p+i- Since the cardinality of Pl5 d_1 



is infinite, we have a contradiction to Lemma 7.5 



□ 

The maximal number of equiangular lines in C d is d 2 and the existence is 
settled for small d at least, cf. [32], El [331 GEl E]- Equivalently, we may say 
that the maximal number of distinct points {xj}™ =l on the unit complex 
sphere is d 2 if we suppose that \(xi,Xj) \ = c for all i ^ j and some constant 
c. 

Example 7.6. Let {/j}| =1 be unit norm vectors in C 2 , so that each of 
them lies on exactly one line of a collection of 4 equiangular lines. The 
lower frame redundancy tells us that we can remove one arbitrary element 
and are still left with a frame since Ai = 2. On the other hand, {fj}^ =1 is 



2-tight, cf. [21 [3], so that Proposition 7.4 implies that we can even remove 2 
elements. 

7.3. Equivalence of frames. We call two stochastic frames X and Y for 
K. d equivalent if there is a unitary matrix U such that tt(Y) = tt(UX) almost 
everywhere on I/O, where it is the projection from into projective 
space. Consistently, we say that two frames are equivalent if one can be 
derived from the other by a unitary transform, permuting its elements, and 
multiplication of each frame vector with some nonzero number. Clearly, 
two equivalent frames share the same frame signature. In the following we 
investigate on the converse relation: If the frame signatures coincide, are 
the two frames equivalent? We shall provide some examples supporting an 
affirmative answer. 

The frame gaps of the uniform distribution on the unit sphere are all 
zero. The uniform distribution is unitarily invariant and its projection into 
projective space yields the uniform distribution there. The moments in 
projective space of any other distribution on the sphere whose frame gaps 
all vanish must coincide with those of the uniform distribution. Due to the 
uniqueness of moments in projective space, the distribution coincide there 
and, hence, must be equivalent on the sphere. For instance, a random vector 
of i.i.d Gaussian entries is equivalent to the uniform distribution. 



Let us revisit Example 7.1 1): 
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Example 7.7. Let {xj} d t^ C M d . If its signature satisfies B p = k, for all 
p > 1, and Ai = 1, then it is equivalent to an orthogonal basis, in which 
one element is repeated k times. Indeed, the upper signature yields that 
there is one element repeated k times and the other elements are orthogonal 
to them. A\ = 1 then implies that the remaining elements are pairwise 
orthogonal. 

For certain numbers of frame vectors, the first or second frame gap being 
zero can determine the frame up to equivalence: 

Example 7.8. 1) Let the signature of {xj} d +\ C ^ d satisfy A\ = B\. 
Then the vectors are equiangular [271 [26] an d the {xj} d ~l\ are deter- 
mined up to equivalence. 
2) Let the signature of {xj}] =1 C K d satisfy A 2 = B 2 . Ifn = l/2d{d+l) 
in the real case (or n = d 2 in the complex setting), then {xj}™ =1 are 
equivalent to an equiangular collection on the sphere [H [2]. The 
n-point homogeneity of the unit sphere yields that the {xj}" =1 are 
determined up to equivalence. 



8. Fusion frames cannot be tight frames for 



pdxd 



So far, we considered elements {Tj}™ =1 C M. dxd that form certain types 
of frames for Mr. We now shift perspectives and explore their frame prop- 
erties in the space M. dxd itself. The main result of the present section is the 
following negative finding: 

Theorem 8.1. Let {Vj}™ =1 C M. d be linear subspaces of dimension 1 < kj < 
d, j = 1, . . . , n, respectively, and {Pt^}" =1 C M. dxd the associated orthogonal 
projectors. Then there are no numbers {cj}" =1 such that {cj-Pv}}"=i is a 
tight frame for the space of symmetric matrices in M. dxd . 



Note that Theorem 8.1 also implies that {c^Py,. }" =1 cannot be a tight 
frames for R dxd . 

Proof. Let Jif denote the space of symmetric matrices in M. dxd and suppose 
that {cjPvj }™ = i is a tight frame for Jif . Then there is a positive constant 
A > such that, for all X £ 

n n 

(23) ^cf(X,iV,)P v ,=AX, ^ C 2|(X,Pvs)| 2 = ^ll^l| 2 - 
i=i j=l 



Using the left-hand side of (23), choosing X = eje*, and summing up over 
i yield 
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Results in [3] then imply A=\ £? =1 c)k). If we make use of the right-hand 



side of (23) and take X = xx* , then we obtain, for all x G Mr, 

n 

^Tc]\\P Vj (x)\\ 4 = A\\x\\\ 

3=1 

As in [3l Proof of Theorem 4.2], we can use the Laplacian on both sides and 
derive 

n 

£>f (1 + k 3 /2)\\P V] {x)\\ 2 = A(l + d/2)\\x\\ 2 , 

3=1 

which yields A(l + d/2) = \ YTj=\ c ]i l + k j/ 2 ) k j, cf. \3\. We now have two 
equations for A that contradict each other. □ 

9. Conclusions 

As the main result of the present paper, we derived an algorithm to con- 
struct unit norm tight generalized frames that are close to a given unit norm 
generalized frame. We also derived almost-tight generalized frames as sam- 
ples from a suitable probability distribution that we called stochastic tight 
generalized p- frames. Such almost-tight generalized frames yield signal re- 
construction up to a certain precision without the cumbersome inversion of 
the frame operator. Examples of stochastic tight generalized p-frames were 
derived from compressed sensing, and we introduced the frame signature as 
a measure of redundancy and discussed its relation to erasures. 

The above results give rise to the following questions: 

1) Given a unit norm almost-tight generalized frame (or fusion frame), 
can we find sharp estimates on its distance to the nearest unit norm 
tight generalized frame (or fusion frame)? 

2) Does the frame signature inherit sufficient information to derive 
sharp statements about how many arbitrary elements of a frame 
can be removed, yet still have a frame? For fixed d and n, does the 
signature even determine the frame up to equivalence? 
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